The Levy spin glass transition 
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We determine the phase transition of the Levy spin glass. A regularized model where the 
coupling constants smaller than some cutoff e are neglected can be studied by the cavity 
method for diluted spin glasses. We show how to handle the e — > limit and determine 
the de Almeida-Thouless transition temperature in presence of an external field. Contrary 
to previous findings, in zero external field we do not find any stable replica-symmetric spin 
glass phase : the spin glass phase is always a replica-symmetry-broken phase. 

The Levy spin glass, introduced in Q, is a mean field spin glass model where the distribution 
of couplings has a power law tail with a diverging second moment. This model can be useful to 
study some experimental situations (like metallic spin glasses with RKKY interactions), it also 
provides a situation which is intermediate between the SK model |§] and finite connectivity mean 
field spin glasses [||, ||, ||, |^]. It is particularly relevant for the study of the importance of rare, but 
strong, coupling constants. In their pioneering work, Cizeau and Bouchaud [|J have computed the 
spin glass transition temperature, and argued that these rare and strong couplings can stabilize a 
replica symmetric (RS) stable spin glass phase in the absence of external magnetic field. Here we 
revisit this problem using the RS cavity method. We show that replica symmetry is always broken 
in the spin glass phase, and we compute the de Almeida Thouless (AT) line j?]] giving the phase 
diagram as function of temperature and magnetic field. 

We consider an Ising spin glass with Hamiltonian 

H a s i}) = -\ E 3 ^s 3 - h cxt y, s t , (i) 

(m) » 

where the sum is over all pairs of spins S{ = ±1, i = l,...,N and h ext denotes an external field. 
The couplings Jy = Jji are independent, identically distributed random variables drawn from the 
distribution 

p ^ J ) = ww^ 6 ^- N ' 1,a ^ (2) 

where 9(x) denotes the Heaviside function and a G]l,2[ is a parameter. The coupling distribution 
is dominated by its power law tails which are equivalent to those of a Levy distribution with 
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parameter a |^. The scaling of the couplings with N ensures that the free energy corresponding to 
the Hamiltonian (|l]) is extensive jjj . 

The equilibrium thermodynamic properties of the system at temperature 1/(3 can be deduced 
from the probability distribution P{h) of local fields hi parametrizing the marginal distribution of 
spin variables by P{Si) = ' */2 cosh(/3/ij). Adding a new site % = with corresponding couplings 
Joi to the system the new field ho is given by [||] 

JV 

h = h ext + ^2 u ( h i> J 0i) (3) 

i=l 

where u(h, J) = atanh(tanh(/?/i) tanh(/3J)) / (5. 

This relation can be turned into a self-consistent equation for P(h) by averaging over hi and 
Joi- Within the assumption of replica symmetry the hi are independent and we find in the thermo- 
dynamic limit N — > oo 

P{h) = f\\dhiP{hi) [l\dJoiP a (Joi) 5(h-h ext -J2 u (hi,Joi)) 

i i i=l 



is{h - h ext ) + 2/ dh'P(h') ( r^[e- is < h '^ - 1) (4) 



ds 

2^ 6XP 

For /i ext = this equation is equivalent to the one obtained in [jl(J using the replica method. 
Notice that the result is universal : the field distribution P(h) depends only on the Levy tail of the 
distribution of couplings P a , not on the precise definition of its cutoff at small J. 

It is instructive to solve (||) numerically with a population dynamics |(| method. In order to do 
this, one should first realize that in the update equation (|3|) the main contribution is obtained from 
the relatively rare couplings which are finite in the large iV limit. Let us introduce a threshold e 
and divide the couplings into strong (|Jy| > e) and weak (\Jij\ < e) couplings. Eq. (||) involves 
a sum over 0(e~ a ) strong couplings, which is treated exactly, and a sum over O(N) weak ones, 
which is approximated by a Gaussian random variable z with zero mean and a variance determined 
self-consistently. The resulting population dynamics algorithm is given by [0] : 

K 

hj = /iext + ^2 U ^ fc ' Jfc ) + Z 
k=l 

r£ dJ 



z* = aj dhP(h) ^ J) (5) 

where K is a Poissonian with average e~ a . In this form the algorithm represents a noisy variant of 
the one used for locally tree-like graphs ||. 
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Fig. 1: Distribution of local fields P(h), for a — 1.1 and T = 0.9 T c (blue), T = 0.6 T c (red), and T = 0.1 T c 
(green). The dotted lines are the corresponding results within the Gaussian approximation proposed in [Q. 
Left : P(h) obtained from population dynamics with e = 0.3. Right : The second moment of P(h), obtained 
with the population dynamics method as function of the regularization parameter e. 

When h cxt = 0, one easily finds that P(h) = 5(h) for T > T c (a), and P(h) becomes non-trivial 
at T < T c (a). The spin glass transition temperature T c (a) is independent of e, it is given by 



as found in jlj [HJ. 

It is interesting to study the dependence of the resulting distributions P(h) on e. The correct 
(within the RS approximation) P(h) is obtained in the limit e — > whereas the limit e — > oo 
amounts to approximating P(h) by a Gaussian, as in We show in Fig. |l| the second moment 
(h 2 ) of P(h) as a function of e. The convergence of (h 2 ) in the limit e — > is very smooth and results 
obtained for e = 0.2. . . 0.5 are already very good approximations for the exact value at e = 0. A 
truncated model where the weak bonds are completely neglected would also give the correct result 
when e — > 0, but the convergence is much faster with our self-consistent Gaussian approximation 
for the weak bonds. 

In zero external field, we have checked the result by a direct iteration of @ using the fast Fourier 
transform. Fig. |l| shows some examples of P(h), together with the Gaussian form proposed in 
It is clear that P(h) deviates from a Gaussian distribution. This can already be seen from @ : 
inserting a Gaussian P(h') in the r.h.s. does not produce one in the l.h.s. 

We now turn to the computation of the AT line, characterized by replica symmetry breaking 
(RSB). The RS cavity method described above is valid as long as the spin glass susceptibility, 
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XSG = Yli j (( s i s j) ~ ( s i) ( S j)) 2 /N, is finite. The divergence of xsg signals the appearance of the 
spin glass phase. In order to compute this susceptibility, we use the truncated model where we keep 
only the strong bonds with \Jy \ > e, while the weak bonds are neglected. The exact value of xsg 
is obtained in the limit e — > 0. In the truncated model, the graph of interacting spins is a diluted 
Erdos-Renyi random graph : in the N — > oo limit (taken before the e — > limit), the number of 
spins interacting with a given spin is a Poissonian random variable with mean e~ a . This graph is 
locally tree-like, in the sense that, if one looks at all the spins at distance < r of a given spin Sj, 
their interaction graph is typically, in the large N limit, a tree of depth r. This allows to compute 
XSG as (|, H : 

oo 

XSG = 5>~ Qr C 2 (r) (7) 

r=l 

where C2(r) is the average square correlation, ((siSj) — {si)(sj)) 2 , between two sites i, j at distance 
r. As we will see, C^r) decays exponentially with distance as C^r) = Ae~ r ^. We thus define the 
stability parameter A = e~ a e~ 1 ^. This parameter is the rate of the geometric series ([?]) giving xsg- 
The spin glass phase transition is given by the condition A = 1. 

Because of the locally-tree-like structure of the interaction graph in the truncated model, the 
computation of A reduces to the study of a one dimensional Levy spin glass model, with energy 
given by : 

r— 1 r 
E = — JnS n S n +l — h n s n , (8) 
n=l n=l 

where the couplings J n are independent random variables drawn from the distribution P Q>£ (J) = 
ae a /(2\ J\ 1+a )8(\ J\ — e), and h n are independent random variables drawn from the distribution of 
cavity fields P (h) determined above. C<i(r) is the average square correlation {(s\s r ) — (si)(s r )) 2 , 
and one is interested in computing the decay rate l/£ = — lirm-^oo log(C2(r))/r. While this one- 
dimensional system looks simple, it requires some special care. The usual 'population approach' 
used in finite connectivity spin glasses (|| [j| [l^]) fails in the Levy case, because the ratio between 
the average and the typical correlation diverges in the small e limit : the well known 'non-self- 
averageness' of correlation functions becomes crucial in this case. This fact is most easily seen 
in the case where the fields h n are equal to zero. As we have seen, this happens when h ext = 
and T > T c (a). The average correlation is C2(r) = (J dJP at£ ( J) tanh 2 (/3J)) r ; in the limit where 
e goes to this gives e _1// ^ = e a (adJ / J 1+a ) tanh 2 (/3J). Therefore the stability parameter is 
A = f™(adJ/J 1+a ) tanh 2 (^J) : the diver gence of the spin glass susceptibility occurs exactly at 



5 



the value T c given by (||) where the distribution of local fields becomes non-trivial. The typical 
correlation is exp (r J dJP Q£ (J) log(tanh 2 (3 J)) , it behaves as e 2r <C e ar in the small e limit. This 
means that the average correlation C^r) is totally dominated by rare realizations : its numerical 
estimate would require an average over 0(l/e^ 2 ~ a ^ r ) samples. 

In order to get around this problem, one must solve analytically the one-dimensional Levy spin 
glass problem described in (||). This can be done either with the replica approach of [Q, or using a 
cavity type approach. Both methods give the same result, the detailed computations will be given in 



Let us just describe in a nutshell the basic steps of the cavity approach. One first solves the one 
dimensional spin glass model (|8|) using the cavity method. The solution is given in terms of some 
cavity fields g n which satisfy the update equations g n +i = h n+ \ + u(g n , J n ). Then one studies the 
spin glass correlation through the response of g n to a perturbation in g±. Calling A n = {dg n /dg\ ) 2 , 
linear response theory gives A n+ \ = (du(g n , J n )/dg n ) 2 A n . Let us denote by P n {g n ,A n ) the joint 
probability distribution of g n and A n , over realizations of the random variables {h p }, p G {l,w}, 
and {J p }, p € {1, n — 1}. The update equations giving g n +i and A n+ i in terms of g n and A n induces 
a mapping P ra +i = F(P n ) for the joint probability distribution. In order to study this mapping, one 
can introduce the function f n (9n) = / dA n A n P n (g n , A n ). It satisfies the recursion relation : 

dg n J dJ n P a)e {J n ) J dh n+l P{h n+l ) ( ^ n \ f n {9n)S(g n +i ~ [K+i +u(9n,J n )}) ■ 

(9) 

This linear equation, / n+ i(<7 n+ i) = J dg n K(g n+ i, g n ) f n (g n ) , defines the transfer matrix operator 
K(x,y). The correlation length £ is given in terms of the largest eigenvalue v of K by v = e^ 1 ^. 
The computation of v is most easily done by changing from the right to the left eigenvalue equation. 
This gives the eigenvalue equation : 



(10) 



u<p(x) = J dJP at£ (J) J dhP(h) ( d^ J) ) <t>(h + u(x, J))) = J dyK T {x,y)<i){y) 

The largest eigenvalue of the linear operator K can be found numerically by iterating (]Io|) 
4>n(x) = / dyK T (x,y)(f) n -i(y)/Z n , starting from an arbitrary function 4>o(x). At each step the 
constant Z n is computed by imposing a normalisation condition j dxcj) n (x) = 1. After many ite- 
rations the function 4> n (x) converges to the eigenvector of K with the largest eigenvalue, and the 
normalisation converges to linin^oo Z n = v = exp(— 1/£). 

In order to find the AT line one must hence use the P(h) distribution as determined above with 
(|5|) and then find the correlation length £ of the one-dimensional problem using the 4> n iteration in 
(|10|). With this proced ure the limit e — > is smooth, and this allows for a clean determination of 
the AT line, as shown in Fig.|2|. 
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Fig. 2: Determination of the de Almeida Thouless line. Left : Stability parameter A as functions of tempe- 
rature for a — 1.5 and h cxt = 0, 0.5, 1 and 2 (from right to left). From the intersection of the curves with 
the stability boundary A = 1 the AT-line is determined. Right : Phase diagram of a Levy spin glass with 
a = 1.5 (red) and a = 1.1 (green). Above the AT-lines shown RS is stable, below it is unstable. 

The behaviour of the stability parameter A can be studied analytically in zero external field 
close to the critical temperature. Writing r = 1 — T/T c (a), one must compute the second and 



fourth moments of P(h) up to order r 2 , and then expand the eigenvalue equation (10). One finds 
after some work A = 1 + (a 2 /3) (T 2 (a) + 2T 4 (a))/(T 2 (a) - T 4 (a)) r 2 + 0(r 3 ), where T n (a) = 
J °° adx/x 1+a tanh n x. As the coefficient of r 2 is positive for all a G]l, 2[, the RS solution is always 
unstable close to T c , contrary to what was found with the Gaussian Ansatz Q. The same is obtained 
numerically in presence of an external field : we have not found any evidence for a stable RS spin 
glass phase, at all the values of a and /i ex t that we have studied. 

To summarize, we have shown how the Levy spin glass problem can be studied naturally within 
the framework of diluted spin glasses, using a decomposition of the couplings into strong and weak. 
The resulting phase diagram is very similar to the one found in other mean field spin glasses. 
In particular, the spin glass phase is never replica symmetric. The large fluctuations due to the 
presence of rare strong couplings request the introduction of some rather sophisticated methods in 
order to compute the spin glass instability. These fluctuations are even more pronounced in the case 
a < 1 not treated here where the free energy ceases to be self- averaging. They will also complicate 
the discussion of the RSB solution of the Levy glass. 
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